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ABSTRACT. We investigate a semiparametric regression model where one 
gets noisy non linear non invertible functions of the observations. We focus on 
the application to bearings-only tracking. We first investigate the least 
squares estimator and prove its consistency and asymptotic normality under 
mild assumptions. We study the semiparametric likelihood process and prove 
local asymptotic normality of the model. This allows to define the efficient 
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1 Introduction 

In bearings-only tracking (BOT), one gets information about the trajectory of a target 
only via bearing measurements obtained by a moving observer. This is a highly ill-posed 
problem which requires, so that one be able to propose solutions, the choice of a trajectory 
model. The literature on the subject is very large, and many algorithms have been proposed 
to track the target, see for instance [2], [1], [ID], All these algorithms are designed for 
particular classes of models for the trajectory of the target. In [BJ, the author proved that 
the least squares estimator may be very sensitive to some small deterministic perturbations, 
in which case the algorithms are highly non robust. However, it has been also claimed in 
[6J that stochastic perturbations do not essentially alter the performances of the estimator. 
The aim of this paper is to develop an estimation theory for a semiparametric model that 
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applies to BOT. The model we study is the following: 



Xk = Se{tk) + £ki 
Y k = y(Xk,tk) + V k . 



(1) 



(i, 9) i— > Sg(t) is a known map from [0, 1] x O to M. d , © is the parameter set (in general, a 
subset of a finite dimensional euclidian space), (x,t) \— * ^(x,t) is a known function from 
M. d x [0, 1] to R, which in general is non invertible, (tk)keN is the sequence of observation 
times in [0,1], (ek)k€N is a sequence of random variables taking values in W 1 , (Vk)keN is 
a sequence of centered i.i.d. random variables taking values in R, with known marginal 
distribution g(x)dx, variance a 2 , and independent of the sequence (ek)keN- The sequence 
(Xk)i<k<n is not observed. We aim at estimating 9 using only the observations (lfc)i<fc<n- 
In case of BOT, (Xk)i<k< n is the trajectory of the target, given by its euclidian coordinates 
at times (tk)i< k <n (d = 2), Sg(-) is the parametric trajectory the target is assumed to follow 
up to some parameter 9, for instance uniform linear motion, or a sequence of uniform linear 
and circular motions, (efc)i<fc<n is a noise sequence to take into account the fact that the 
model is only an idealization of the true trajectory and to allow stochastic departures of 
the trajectory model, and (Vk)i<k<n is the observation noise. Since the observer is moving, 
if (O(i))ie[o,i] is its trajectory, the function ^(x,t) is the angle, with respect to some fixed 
direction, of x — 0(t), that is, for x = (xi,X2) T '- 



In such a case, for any z and fixed t, the set {x : ^f(x,t) = z} is infinite. Our aim 
here is to understand how it is possible to estimate the parameter 9 in model (JTJ) , what 
are the limitations in the statistical performances, to propose estimation procedures, to 
build confidence regions for 9 and to discuss their optimality under the weakest possible 
assumptions on the sequence (ek)keN- Indeed, we would like to apply the results to BOT 
under realistic assumptions, for which it is not a strong assumption to assume that the 
observation noise (Vk)keN consists of i.i.d. random variables with known distribution, but 
the trajectory noise (efc)fceN rnay be quite complicated and unknown. To begin with, we 
will assume that the variables (ek)keN are i-i-d. with unknown distribution. 
As such, the model may be viewed as a regression model with two variables, in which one 
of the variables is random, is not observed and follows itself a regression model. One could 
think that it looks like an inverse problem, or that the model may be understood as a state 
space model, or a mixed effects model, but in a nonstandard way, so that we have not been 
able to find results in the literature that apply to this setting. 

Throughout the paper, observations (lfc)i<fc<n are assumed to follow model (P) with true 
(unknown) parameter 9* and the observation times are tk = ^, k = 1, . . . , n. All norms || • || 



^(x,t) = arctan[x 2 - 2 (t)]/[x 1 - Oi(t)]. 



(2) 
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are euclidian norms. 

In Section El we consider least squares estimation and prove consistency and asymptotic 
normality in this setting, see Theorems Q] and El This allows to introduce basic consider- 
ations and set some assumptions. We prove that the results apply to BOT for linear 
observable trajectory models and when the trajectory noise has an isotropic distribution, 
see Theorem O Then, in Section [3] we study the likelihood process to set local asymptotic 
normality and efficiency in the parametric setting where the density of the noise (efc)fcgN 
is known, and define the efficient Fisher information in the semiparametric setting where 
the density of the noise (ek)keN is unknown. This also gives an estimation criterion which 
may be used even if the trajectory noise is correlated. In Section 01 we propose strate- 
gies for semiparametric estimation and discuss possible extension of the results to possibly 
dependent trajectory noise (£k)keN- Section [5] is devoted to simulations. In each section, 
particular attention is given to the application of the results to BOT. 

2 Least squares estimation 

In sections [2] and [3] we will use 

Assumption 1 (efc)fcGN is a sequence of i.i.d. random variables. 

To be able to obtain a consistent estimator of 8, we require that, in the absence of noise 
(both observation noise and trajectory noise), the observation at all times is sufficient to 
retrieve the parameter. We thus introduce 

Assumption 2 If 9 G 6 is such that ty(Sg(t),t) = $?(Sg*(t),t) a.e. for all t G [0,1], then 
9 = 9*. 

This is the observability assumption. 

If the observation noise is centered, in the absence of trajectory noise, the fact that only 
*&(S$(t), t) is observed with additive noise is not an obstacle to the estimation of 9 under 
Assumption [21 But with trajectory noise, only the distribution of ^(So^t) + £i,i) may 
be retrieved from noisy data. In case the marginal distribution of the e^'s is known, this 
may be enough, but in case it is unknown, one has to be aware of some link between the 
distribution of ty(So(t) + £i,i) and 9. We thus introduce the following assumption, which 
will be proved to hold in some BOT situations. 

Assumption 3 For all t G [0, 1], for all 6 G O, 

E{^[S e (t)+e 1 ,t]} = ^[Se(t),t}. 
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Let us now define the least squares criterion and the least squares estimator (LSE) by 

n 

M n (9) = -y2(Y k -*[S e (t k ),t k }) 2 , 
k=\ 

6 n = argmin M n (9), 
where argming g e M n (9) is any minimizer of M n . 

2.1 Consistency 

We assume that is a compact subset of W 11 , and we will use 

Assumption 4 t h E (fy[Sg* (t) + e\, t]) 2 defines a finite continuous function on [0,1], 
sup te [ ,i] E{(^[5e* (t) + £±, t]) 2 1(^[5 ( t ) +£l t]) 2 >Ri} t en ds to as M tends to infinity, and 
(t,9) i— > ty[Sg(t), t] defines a finite continuous function on [0,1] x 6. 

Theorem 1 Under assumptions^ ,0,0 and[7], n converges in probability to 8* as n tends 
to infinity. 

The proof is a consequence of general results in M-estimation. We begin with a simple 
Lemma: 

Lemma 1 Under Assumption^ ifF(-, •) is a real function onlR^xfO, 1] such that sup t6 r 0; H E|i ? (ei,t)| 
is finite, liniM^+oo su Pte[o,i] ^{\ F ( £ i^)\l\F(ei,t)\>M} = 0? andKF(e\, •) is Riemann-integrable, 
then 

1 n 

-Y^F{e k ,t k ) 

k=l 

converges in probability to j KF (ei , t) dt as n tends to infinity. 
Proof 

First of all, by the integr ability assumption, 



1 - 

- VEF (e k ,t k ) 
n ^-^ 

k=l 

converges to £MF(E!,t)dt as n tends to infinity. Then 
Y n 1 n 

- l F - KF ^k,t k )] = - J2 [ F (£k,t k ) ^\F{e k ,t k )\>M ~ ^{F(e k , t k )l lF[£kA)l>M }] 

k=l 
1 - 

+ ^ Yl [ F ( £fc ' tfc ) l \F{e k ,t k )\<M ~ E{-F(efc, tk)l\F(s k ,t h )\<M}] ■ 



n « — ' n 

k=l k=l 



n 
k=l 
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The variance of the second term is upper bounded by 2— so that the second term tends to 
in probability as n tends to infinity, and the absolute value of the first term has expectation 
upper bounded by 2sup te r 0) i] E{|F(ei,f)|l| J ?( eijt M > j W -} ; which may be made smaller than 
any positive e for big enough M, which proves the lemma. 
Define now 

Af(0)= / E(tf[S fl .(t)+ei,t] -*[S e (t),t]) 2 dt + a 2 . 
Jo 

Direct calculations yield 
M(9) - M(<9*) 

= J E (i*[Sg.(t) + ei,t] - nS e (t),t}} 2 - {*[Sp(t)+ei,t] - y[S e »(t),t}} 2 ^ dt 

= f {* [S e * (t) , t] - ¥ [S (t) , t] } x {2E (* [S 6 * (t) + ei , t] ) - ¥ [5 e . (t ) , t] - * [5„ (t ) , t] } dt . 
Jo 

By Assumption O it follows that 

M(0)-M{6*) = f WSo(t),t] - y[S e «(t),t}} 2 dt 
Jo 

so that M{6) has a unique minimum at 9* by Assumption [2l Also, under Assumption 01 
6 i— > M(9) is uniformly continuous from to R. 
Now, for any 0, 

n n 

fc=l k=l 
1 " 

(*[-M**) +£k,t k ] ~ V[S e (t k ),t k }) 2 . 

k=l 

H Sfc=i ^4 2 converges in probability to cr 2 ; the variance of £ £fc=i ^4 (^[S'e* (ifc) + £fc, *fc] - 
is SiELl^^I^'fe) + £ fc>*fc] - *[5 , 6»(tA;),tfc]) 2 , which converges to 0, so that 
\ YTk=\ v k (V[Se*{tk) + £fe,*fe] - *[-Se(*fc),*jfe]) converges in probability to 0; and applying 
LemmaCEl i ££=1 + - *[/Se(tjfe), tfc]) 2 converges in probability to 

Jo E (i) + ei, t] - ^[X e (t),t]) 2 dt. Thus for any 6 G 9, M„(0) converges in probabil- 

ity to M(0). 

Using the compacity of and the second part of Assumption HJ it is possible to strengthen 
this pointwise convergence to a uniform one: 



sup|M n (0)-M(0)|=op 9 ,(l). 
see 



(3) 
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Indeed, for any 9\ and 9 2 in G, 

Af„(0i) - M n (9 2 ) 
1 n 

= - Y,( 2 *i s e*(tk) + e k ,t k ] -*[S 01 (t k ),t k ] - *[So 2 (t k ),t k ])(*[So 2 (t k ),t k ] -y[S dl (t k ),t k }) 

k=l 

2 n 

+ -^2v k mSe 2 (t k ),t k ]-^[S ei (tk),tk}) 

h=l 



so that for any 5 > 0, 




where w(-) is the uniform modulus of continuity of (t, 9) 1— > ^[^(i), t]. The right-hand side 
of the inequality converges in probability by Lemma [T] to a constant times uj(5), so that 
equation (|3|) follows from compacity of 0. Theorem Q] now follows from [T3] Theorem 5.7. 

2.2 Asymptotic normality 

Asymptotic normality of the least squares estimator will follow using usual arguments 
under further regularity assumptions. 

Assumption 5 There exists a neighborhood U of 9* such that for all t £ [0,1], 6 1— > 
SSf[Se(t), t] possesses two derivatives on U that are continuous as functions of (6,t) over 
U x [0,1]. 

If 9 1— ► F is a twice differentiable function, let VgF{9') denote the gradient of F at 9', and 
D 2 e F{9') the hessian of F at 0'. Define for 9 £ U: 

I R {9) = f 'Vo*[Sg(t),t]Vg*[Sg(t),t] T dt 

Jo 

h(0) = J EmS e *(t)+e u t] -^[S e (t),t]} 2 V e ^[Se(t),t}V e ^[S e (t),t} T dt. 

Then: 

Theorem 2 Under Assumptions EL El [7] o,nd\^ if Ir{9*) is non singular, 

MOn ~ 9*) = 

1 n 

I R (9*)- 1 —Y,{^[Se*(t k ) + e k ,t k ] - *[S e *(t k ),t k ] +V k }V e *[S g .(t k ),t k ]+o Ps .(l). 
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In particular, y/n(9 n — 9*) converges in distribution to M (0,1™ (9*)) where 

!m = [h(e*) + o- 2 i R (e*)] i R l (o*). 



Let us notice that, for a null sequence (£fc)fceN> we retrieve the usual Fisher information 
matrix for the parametric regression model. 

The proof follows Wald's arguments. On the set (9 n G U), which has probability tending 
to 1 according to Theorem [TJ 

V e M n (9 n ) = = V e M n {6*) + [ D 2 e M n [6* + s{9 n - 9*)} ds (9 n - 9*). 

Jo 

Direct calculations yield for any 9 G U 
2 n 

V e M n {9) = — Y^{^[Se*(t k ) + e k ,t k ] + V k - ^[Se{t k ),t k ]}V e ^[So(t k ),t k ], 

k=l 

and 

2 n 

D 2 e M n (9) = -S2v e nSe(t k ),t k }V e ^[S e (t k ),t k } T 

k=l 

2 - 

--T{^S e *(t k ) + £ k ,t k } + V k -^S e (t k ),t k }}D 2 e V[Se(t k ),t k ]. (4) 

k=l 

Notice that, using Assumption [3l VgM n (9*) is a centered random variable, and that, using 
Assumptions HUH the variance of VgM n (9*) converges to 4 [1^(9*) + ct 2 /r(#*)] as n — > +oo. 
Also using Assumptions [31 [U El an d applying Lemma [Q D 2 M n {9) converges in probability 
to 2Ir(9) as n — > +oo. 

Using Assumption El there exists an increasing function u> satisfying lims^o lo(5) = such 
that, for all (9, 9') G U 2 with \\9 - 9'\\ < 6, 

1 " 

\\D 2 M n {9) - D 2 M n {9')\\ <co(6) x - £ (|*[S e .(t fc ) + e k ,t k ] + V k \ + 2) . 

fe=i 

It follows that on the set (9 n G J7) 

1 " 

||£>f M n [0* + s(# n - 0*)] - D 2 M n (9*)\\ < oj(\\e n - 9*\\)x-J2 (l*[5fl.(t fc ) + e fc ,tfc] + Vfcl + 2) . 

fe=l 
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By Lemma[U - Ylk=i \^[So* (tk) + £k, t k ] + V k \ = Op e „ (1) so that, using the consistency of 
9 n , Lemma [T] and Assumption [5} 

/ D$M n [6* + s(9 n - 9*)} ds = 2I R {6*) + o Fgt (1). 
Jo 

Finally, we obtain 

(1^(0*) + o Pe , (1)) </a(p n -o*) = 

f2MSe*(t k ) + e k ,t k ] +V k - *[S e *(t k ),t k ]}V e *[S e *(t k ),t k ] + o Pflt (1). 
v k=i 

Using Assumption [SJ the convergence in distribution to M (0, 1^(9*)) is a consequence of 
the Lindeb erg- Feller Theorem and Slutzky's Lemma. 

Notice that, if Im is a consistent estimator of Im(9*), by Slutsky's Lemma, 
V?"Af — ^*) converges in distribution to the centered standard gaussian distribution in 
M m , which allows to build confidence regions with asymptotic known level. If the distribu- 
tion of the trajectory noise (e k ) is known, one may use Im = Im^u)- If the distribution of 
the noise is unknown, one could use bootstrap procedures to build confidence regions based 
on the empirical distribution of 9 n using bootstrap replicates. 

Another possibility occurs if one has a majoration 

E{*[5 fl .(t) +e u t] -^[S e *(t),t]} 2 < A 2 , (5) 

where A denotes a known constant. Indeed, in such a case, 1^(6*) is upper bounded (in 
the natural ordering of positive symetric matrices) by A 2 Ir(9*), so that I M l {9*) is upper 
bounded by {A 2 + a 2 )I^(9*), and one may use (A 2 + a 2 )I R 1 (9 n ) as variance matrix to 
obtain conservative confidence regions. 

2.3 Application to BOT 

To apply the results to BOT, one has to see whether Assumptions HJ EJ El S] and [5] hold 
and if Ir(6*) is non singular. 

Assumption [2] is the usual observability assumption which holds for models such as uniform 
linear motion if the observer does not move itself along uniform linear motion , or a sequence 
of uniform linear and circular motions, if the observer does not move along uniform linear 
motion or circular motion in the same time intervals as the target. Various observability 
properties are proved in [7]. 

Assumptions H] and hold as soon as the trajectory model Sg(t) is twice differentiable for 
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all t as a function of 9 and the denominator in ([2]) may not be 0, that is the bearing exact 
measurements of the non noisy possible trajectory stay inside an interval with length tt. 
This may be seen as an assumption on the manoeuvres of the observer. This is a usual 
assumption in BOT literature. The fact that Ir(9*) is non singular is equivalent to the 
observability assumptions for linear models. Let us introduce such models. 
Let ei(i), . . . , e p (t) be continuous functions on [0, 1], 9 = (ai, . . . , a p , bi, . . . , b p ) T , 

( a iei (t) + -.. + a p e p (t)\ 
\ b iei (t) + ... + b p e p (t) J 

Then 

Proposition 1 Under model Assumption^ holds if and only if Ir(9*) is non singular. 
Proof 

Let 9* = (at,...,a* p ,bl,...,b* p ) T . Let 

Se(t) 2 -Q 2 (t) 

m(M) - s d (t) 1 -o 1 (ty 

Simple algebra gives that ^[Se(t),t] = ^[Sg(t),t] if and only if 

p p 
Y,( b k ~ b* k ) e k(t) ~ Y,( a k ~ a* k )e k (t)m{9*,t) = 0, 

k=l k=l 

so that Assumption[2]holds if and only if the functions e\(t), . . . , e p (t), ei(t)m(9* ,t), . . . , e p (t)m(9* ,t) 
are linearly independent in the space of continuous functions on [0, 1]. 
Also, for i = 1, . . . ,p: 

arctanm(6>* i) = — ( j- ^ ) ( - . , — . . ) ei(t)m(9* ,t) 

dai y ,J \l + m(9*,t) 2 J\S e (t) 1 -0 1 (t)J lK J y ' 

and ^ ^ 

7— arctanm(0*,i) = I j- — ^ ) ( „ , . — , , ) eAt), 

dbi v ' ; \l + m(9*,tyJ\Se(t) 1 -0 1 (t)J ^KJ, 

so that Ir(9*) is non singular if and only if the functions ei(t), . . . , e p (t),ei(t)m(9* ,t), . . . , e p (t)m(9* ,t) 
are linearly independent in the space of continuous functions on [0, 1], which ends the proof. 

Thus under model ([6]), if the trajectory of the observer is such that 02(f)— Y%=\ b* k e kit) 7^ 
for all t G [0,1] and Assumption [5] holds, Assumptions H] and [S] hold and Ir(9*) is non 
singular. 



What remains to be seen is whether Assumption [3] holds, and it is the case under a 
simple assumption on the distribution of the trajectory noise: 
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Assumption 6 E\ has an isotropic distribution inM. 2 . 

We introduce some prior knowledge on the trajectory and on the variance of the trajectory 
noise to be able to obtain conservative confidence regions. 

Assumption 7 The trajectory model (t,0) >— * Sg(t) is such that for all (0,t) £0x [0,1], 
|| 0(f) — Sq (t) || > i? m i n , and a constant number A 2 such that 

mill 

is known. 

This condition makes sense since in the context of passive tracking one usually assumes 
that the distance between target and observer is quite large. 

Theorem 3 If the trajectory model (t,6) i— ► Sg(t) and the move of the observer are such 
that Assumptions^ \Q an<i[?] hold and Ir(0*) is non singular, 

or if the trajectory model is the trajectory of the observer is such that 02(f)— 5Z|=i ^*k e k{^) 7^ 
for all t € [0, 1] and Assumption^ holds, 
if moreover Assumption^ and\^ hold, 

then for any a > 0, if C a is a region with coverage 1 — a for the standard gaussian distri- 
bution in M. m , then 

lim inf P*. ( .f 1 I R l/2 (e n ) (6 n - 9*) eC a )>l-a. 

Proof 

Under Assumption El let the density of e\ be F(||e||). Recall that the trajectory of the 
observer is (O(f)) t6[0)1] . Let (3(t) = arctan[S e (f) 2 - 2 (t)]/[S e (t)i - Oi(f)] = ¥[5*(t),t]. 



E{$[Sg(t) +£i,t]} = II arctan 

[X ( — 7T,7r) 



Sg(t) 2 - 02(f) + r sin a 



Se(t)i — Oi(f) + r cos a 



F(r) rdrda , 



Let 



H I ) f / / arctan ( — - m ] — - ) F(r) rdrda. 

1 txC-^TT) \\\0(t)-S e (t)\\+rco S (a-p(t))' 



, r sin a 

Gffj^r, a) = arctan 



||0(f) - S e {t)\\ +rcosaJ ' 



Then, 



E{*[S (t) +ei,t]} = *[5 (f),f] + ( ( G e ,t{r,a)F{r) rdrda. 

J JRx(-n,n) 
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But for any r > 0, for any a, Gg t t(r, —a) = Ggj(r, a) so that 

E{^[S e {t)+s 1 ,t]} = ^[S e (t),t}. 

Now, 

<S[S e *(t)+6 1 ,t]-^[Sg*(t),t] = [ V x *[S e *(t)+h£ 1 ,t] T e 1 dh, 

Jo 

and direct calculations provide 

llv^MH = \\o(t)- x \\-\ 

Thus for any a G]0, 1[: 

E{#[S e *(i)+ £l ,i]-#[S e *(i),i]} 2 < ^ 2 P(|| ei || >a\\0(t)-^[S e *(t)\\) 

E|| £l || 2 



(l-a) 2 \\0(t)--$ [5 fl ^"i- 

Elle I' 2 

< ^ 2 P(|kl|| >ai?min)+ ' 



since \^?(u) — ^{v)\ < 7r for any real numbers it and v, and by using the triangular inequality 

and Assumption 

But Tchebychev inequality leads to 

E{*[£fc.(i) + ei ,t] - *[^,(t),i]} 2 < + (j^a) (7) 

which is minimum for a = 1+7r -2/3 leading to + (i- a )2 ) = 71-2 

(l + vr- 2 / 3 ) and 

E { * [S 6 * (t ) + e x , t] - * [S e * (t) , t] } 2 < A 2 . 

To conclude one may apply the concluding remark of Section 12.21 to obtain asymptotic con- 
servative confidence regions for 9. 



3 Likelihood and efficiency 

Let T be the set of probability densities / on R d such that for all t £ [0, 1], for all 6 £ 0, 

/ +M]/ = (8) 

We will replace Assumptions Q] and by 
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Assumption 8 (efc)feeN is a sequence of i.i.d. random variables with density f* £ T. 



The normalized log-likelihood is the function on @ x T 

iu ) . (9) 



Me, f) = - X>g ( f g in - ns e (t k ) + u , t k }} f( u )di 
n k=i ^ 



Define 



G ((e, V),t; 9) = log (J g{*[S * (t) + e, t] + V - *[S g (t) + u, t]} f(u) du 
where (e, V") has the same distribution as (ei, Vi). 

As soon as for any (6>, f) € 6 x J 7 , it is possible to apply Lemma[]]to G ((•), •; 9), J n (6, f) 
converges in probability to 



J(0,f) 



JR d 



log (^J g {^[S e *(t) + e,t]+v-^[S e (t)+u,t}} f(u)di?j g(v)f*(e)dvdedt. 

(10) 
Let 

P(ej) (z, t)= g{z- V[S g (t) + u, t]} f(u) du 



be the density, for fixed t, of the random variable Z = ty[Sg(t) + U,t] +V where U is a 
random variable in M. d with density / independent of the random variable V in R with 
density g. Thus, pm*j*) (•, tk) is the probability density of Y^. Then, the change of variable 
z = y[S e * (t) +e, t] +v in f R log (/ g {V[S e * (t) +e,t]+v- V[S e (t) + u, t}} f(u) du) g{v) dv 
leads to 



J(0J) = 

Thus, for any (9, f) € 6 x T, 



P(6*,f*) ( z , t) l °SP(e,f) (z, t) dz 



j(8*,n>j(9j), 



dt. 



and J(9*,f*) = J(9,f) if and only if t a.e. P(pn (z,t) = Piq*j*\ (z,t) z a.e., that is the 
probability distribution of ^[S$(t) + U, t] + V, where U is a random variable in M. d with 
density / independent of the random variable V in R with density g, is the same as that of 
ty[Se*(t) + U*,t] + V, where U* is a random variable in R d with density /* independent of 
the random variable V in R with density g. But if / € T and /* G J 7 , taking expectations 
leads to the fact that, t a.e., ^[Sg(t),t] = ^[Se*(t),t], so that 9 = 9* if Assumption [2] holds. 
In other words, J(9,f) is maximum only for 9 = 9*. 

Following the same lines as for the LSE, we may thus easily obtain that, if the probabil- 
ity density /* is known, the parametric maximum likelihood estimator is consistent and 
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asymptotically gaussian. Define the parametric maximum likelihood estimator as : 

Q n = argmax J n (0, /*). 

6»g0 

where argmaxgge J n (9,f*) is any maximizer of J n (-,f*)- 

If for any 9 £ 0, there exists a small open ball containing such that Lemma [U applies to 
supg g[ / G ((•), •; 9), it is possible, as in [2] Theorem 5.14, to strengthen the convergence of 
Jn(G, /*) to J(9, /*) in a uniforme one. The consistency of 9 n follows: 

Theorem 4 Under assumptions^ and\^ if moreover LemmaUl applies to sup eeU G ((•),•; 6*) , 
f/ien i/ie estimator 9 n is consistent. 

We will use the notation Y(i) for Y(t) = ^[Sg. (i) +£i, t] +V\ to simplify the writing of some 
integrals. We shall introduce the assumptions we need to prove the asymptotic distribution 
of 9 n : 

Assumption 9 For all (z,t) £ R x [0,1], t/ie function 9 i— ► P(ej*) ( z >t) *s twice continu- 
ously differentiable. 

For any 9 £ Q, t h-> E||V# logp(gj.) (Y(t),t) || 2 is /mite and continuous. 

There exists a neighborhood U of 9* such that for all 9 £ U , 1 1— > E£)^ logp^ ^*) (Y(i),i) is 

/mife anc? continuous. 

LemmaUl applies to logprgj\ (Y(t),t), for all 9, to \\ Vg logprgj*) (Y(t),t) || 2 and all com- 
ponents of Dq logp(gj*) (Y(i),i) /or G J7. 

Introduce the parametric Fisher information matrix: 

mm t*\ 

dt 



i(9)= iY{ t),t) VePiejf) (Y(t),t) 



Theorem 5 Under assumptions\^\B\ and\Q 9 n converges in probability to 9* as n tends to 
infinity. 

Moreover, if 1(9*) is non singular, 

VE(e n - 9*) = r\e*)±= V VeP{e *' n (Y k , t k ) + op 9 , (i), 

and y/n(6 n — 9*) converges in distribution as n tends to infinity to Af(0, L^ 1 (9*)). 

The proof follows the same lines as that of Theorems [T] and [2] and is left to the reader. 
Notice that under the same assumptions, it is easy to prove that the parametric model is 
locally asymptotically normal in the sense of Le Cam (see [H]) so that if 1(9*) is singular, 
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there exist no regular estimator of 9 which is -y/n-consistent. Thus if Ir(6*) is non singular 
and the assumptions in Theorem [2] hold, in which case the LSE is regular -y/ra-consistent, 
then 1(9* ) is also non singular. 

To investigate the optimality of possible estimators in the semiparametric situation, 
with /* unknown but known to belong to we use Le Cam's theory as developed for non 
i.i.d. observations by Mc Neney and Wellner [5]. Introduce the set B of integrable functions 
b on M. d such that: 

• / b(u)du = and 35 > 0, f* + 5b> 0, 

• for all t £ [0,1], for all 9 € G, 



/ ^[S e (t)+e,t]b(e)de = 0. 



Let H = : 
((a 1 ,b 1 ), (a 2 ,b 2 )} n 



f fg(Y(t)-*[S e .(t)+u,t])b(u)du 
o \fg(Y(t)-*[S e *(t)+u,t])f*(u)du 

x B be endowed with the inner product 



dt < oo. 




f*) (Y(f) f) : fg(Y(t)-*[So.(t) + u,t])b 1 (u)du 
[ U ' } ' ai + fg(Y(t)-*[S e *(t)+u,t})f*(u)du 

f g(Y(t)-V[S e *(t) + u,t])b 2 (u)du\ 



(Y(t),t)-a 2 + 



P(6*J*) 

We will need only local smoothness, so we introduce: 



Jg(Y(t)-V[Sg*(t)+u,t])f*(u)du 



Assumption 10 There exists a neighborhood U of 9* such that for 9 G U: 

For all (z,t) £ I x [0, 1], the function 9 \— * P(oj*) (z,t) is twice continuously differentiable. 

1 1 — ^ E|| V# logprgj*\ (Y(t),t) || 2 is finite and continuous. 

1 1 — ► W,Dq logprgj*\ (Y(t),t) is finite and continuous. 

For any b £ B, for all (z, t) £Mx [0,1], 9 i— ► J g(z — ^ [S$(t) + u, t])b(u)du is continuously 

differentiable and £ i — > E 

Lemma [7] applies to ||V# 
Ve f g(Y(t)-m[S e (t)+u,t])b{u)du 
P(e*,f*){Y(t),t) 



V9 J g(Y(t) l>[Se(t)+u,t] )b{u)du ^ fi n if e an d continuous. 
°SP(e,f*) (y(t),t) \\ 2 ,all components of D# logprgj*\ (Y(t),t) and 
for 9 £U. 



Let Pn^ej) be the distribution of Y\, . . . ,Y n when the parameter is 9 and the density of the 
trajectory noise is /. For (9, /) £ 6 x f , let 



A, 



dp ra[(0i/) (yi,...,y w ) 

dP th(e ., f . ) (Y L ,...,Y n ) 



Jn(9J)-J n (9*,n- 
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Then 



Proposition 2 Assume that Assumption[W{holds. Then the sequence of statistical models 
(^n,(e,f))6eBjeF * s locally asymptotically normal with tangent space TC, that is, for (a,b) £ 

n, 

A n (V + -j=, f* + ^) = W n (a, b)-^\\ (a, b) f n + op fl . (1), 



where 



1 ^fV eP J e , tn fg(Y k -*[Sg.(t k )+u,t k ])b(u)du 



W n (a, b) = -= V (y i fe ) . + 



P(6*,f*) ' f g(Yk-V[Se*(tk) +u,tk])f*(u)du J 

and for any finite subset h\, . . . , h q £ H, the random vector (W n (hi), . . . , W n {h q )) converges 
in distribution to the centered Gaussian vector with covariance {hi,hj)-H- 



Proof 



\„ (0* + 



™ / P(9<+a,/>) — P(9*,f*) i S 6 * + «(t k )+u,t k )b(u)du 

= £log 1+ g — - — -en,**) + 4= 1 — 4rr-^ — J 

= W n (a,6)--||(o,6)||^ + op 9 ,(l), 

by using: Taylor expansion till second order of log(l+u), Taylor expansion till second order 
of 9 i— > pmj») (z, t) and Taylor expansion till first order of t— ► / gf(z— ^ [Se(i) + u, t])6(u)du, 
which gives the first order term W n (a,b), and then applying Lemma Q] to the second order 
terms to get ^|| (a, b) ||^ + o& gt (1). 

The convergence of (W n (h)) to the isonormal process on H comes from Lindeberg 
Theorem applied to finite dimensional marginals. 

The interest of Proposition [2] is that it gives indications on the limitations on the es- 
timation of 6* when /* is unknown. Indeed, the efficient Fisher information I* is given 
by: 

inf II (a, b) IlL = a T I*a : 
beB 

and if I* is non singular, any regular estimator 6 that converges at speed yfn has asymptotic 
covariance £ which is lower bounded (in the sense of positive definite matrices) by (I*) -1 . 
In case Ir(0*) is non singular and the assumptions in Theorem [2] hold, one may deduce 
that I* is non singular. 
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3.1 Application to BOT 

As seen in Section l'2.3t the set of isotropic densities is a subset of T . If g is twice 
differentiable, positive and upper bounded, if the trajectory model 9 ^ S$(t) is twice dif- 
ferentiable for all t £ [0, 1], then Assumptions IU1 and [TU1 hold under almost any trajectory of 
the observer. Indeed, one may apply Lebesgue's Theorem to obtain derivatives of integrals, 
and use the fact that the function z i— > arctanz is infinitely differentiable, has vanishing 
derivatives at infinity, is bounded and has two bounded derivatives, so that if the trajectory 
of the observer is such that, for all 9, the set of times t and points u such that ^f(Se(t) + u, t) 
is or ^ is negligible, then the smoothness assumptions hold. 

Moreover, as seen again in Section [2.31 if the trajectory model is © and satisfies Assump- 
tionEl then Ir(9*) is non singular, so that the efficient Fisher information I* is non singular, 
and all results of Section [3] apply. 

4 Further considerations 

It would be of great interest to have a more explicit general expression of I*, and of greater 
interest to exhibit an asymptotically regular and efficient estimator 9. If one could approx- 
imate the profile likelihood supj g:? r J n (6, f), one could hope that the maximizer 9 of it be 
a good candidate. 

Another possibility would be to use Bayesian estimators. Indeed, in the parametric context, 
the Bernstein-von Mises Theorem tells us that asymptotically, the posterior distribution of 
the parameter is gaussian, centered at the maximum likelihood estimator, and with variance 
the inverse of Fisher information (see [14| for a nice presentation) . Extensions to semipara- 
metric situations are now available, see [3]. To obtain semiparametric Bernstein-von Mises 
Theorems, one has to verify assumptions relating the particular model and the choice of the 
non parametric prior. This could be the object of further work. Then, with an adequate 
choice of the prior on @ x JF, taking advantage of MCMC computations, one could propose 
bayesian methods to estimate 9* (mean posterior, maximum posterior, median posterior 
for example). 

To extend the results of the preceding sections in the case where the trajectory noise is 
no longer a sequence of i.i.d. random variables, one needs to prove laws of large numbers 
and central limit theorems for empirical sums such as - Ylk=i F { £ hi tk), we prove some 
below for stationary weakly dependent sequences (£k)keN- I n such a case, if M(9) and 
J(9, /*) are still the limits of M n {9) and J n (9, /*) respectively, then asymptotics for 9 n and 
9 n could be obtained. Here, J n (#,/*) is no longer the normalized log-likelihood, rather the 
marginal normalized log-likelihood, but J(9,f*) is still a contrast function. 
Since the convergence of the expectation relies on purely deterministic arguments (Rieman 
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integrability) , we focus on centered functions. We assume in this section that 

Assumption 11 (ek)keN is a stationary sequence of random variables such that for all 
t G [0, 1] 

E[F(ei,t)] = 0. 

Denote by (afc)fceN the strong mixing coefficients of the sequence (efc)fcgN defined as in [12], 
that is, for k > 1, 

a k = 2 sup \F(AnB)-F(A)F(B)\. 

£en,Aea(ei:i<i),Bea-{ei:i>k+e) 

and «o = \- Notice that they are also an upper bound for the strong mixing coefficients of 
the sequence (F (e/c, ifc))fceN for any sequence (tfc)fceN of real numbers in [0, 1]. 

Proposition 3 Under Assumption \ll[ if ctk tends to as k — > +oo, i/sup tg r 0] i] E|-F(£i,i)| 
is finite and lim A /^ + oo sup te[01 ] E{\F(ei,t)\l\ F ^ ljt ^ >M } = 0, then 



1 n 

- VF(e fc ,t fc ) 

n — ' 



n 

k=l 



converges in probability to as n tends to infinity. 
Proof 

Using Ibragimov's inequality ([5]), for any M: 



~J2 F ( £fc ' 1 |J , («Jk.*fc)l<Af = ^2 ^ OOV ( F ( £ *' **) Vfe,*i)l<M; ^ <i) V(M*)I<m) 
fc=l / t=l i'=l 



i=l j=l 
i=l 3 -=l 

2M 2 ^ 
n ^-^ 

which tends to by Cesaro as n — ► +oo. 
The end of the proof is similar to that of Lemma [TJ 
Define now 

aT 1 (u) = inf {k G N; : a fc < u} = ^ l u<ai . 

i>0 

Define also for any t £ [0, 1], 



Qt (it) = inf {x G R; : P(|F(ei,t)| > x) < u] , 
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u) du < +00, 



and 

Q (u) = sup Q t (u) 

te[o,i] 

We shall assume that 
Assumption 12 

C a.- 1 ^) Q 2 ( 
Jo 

which is the same as the convergence of the series 

v r Q 2 (u)d U . 

k>0 J ° 

Applying Theorem 1.1 in [T2] one gets for any t E [0, 1] and k > 0: 

|Cov (F (e ,t) ; F (e k ,t))\ < 2 / Q 2 (u) du, 

Jo 

so that if Assumption [12] holds, one may define 

„i +00 „i 

/ Var-F(e ,t)<ft + 2 V / Cov (F (e ,t) ; F (e k ,t)) dt. (11) 
./o ,. \ Jo 



7 2 



fe=l 



Now: 

Proposition 4 Under As sumptions [7JJ and \12l if a 2 > and if for any integer k, the real 
function (t,u) — > Cov (F (eq, i) ; F (e^, n)) is continuous on [0, l] 2 , t/ien 



1 ™ 
— F= / (e k ,t k ) 

v fe=i 



converges in distribution to jV(0,7 ) as n tends to infinity. 
Proof 

Let £ n = ^fc=i ( £ &5 • Fhst of all, let us prove that Va ^' Sn converges to cr 2 as n tends 
to infinity. 



VarS n 



n n 

i=l j=i 



- n n 



I ,„— 1 nA(n-fc) 

Cov^^o,^);^^,^)). 



n 

k=l-n j=lV(l-fc) 
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For any K > 1, using again Theorem 1.1 in [12] 

nA(n—k) 

- J2 Yl Cov{F(e ,ti);F(e k ,t i+k )) 

K<\k\<n-li=lV{l-k) 

which is smaller than any positive e for big enough K under Assumption 1121 
Now, for any fixed integer k, 

nA(n-k) * 

- V Cov(F(e ,U);F(e k ,t i+k ))- / Cov (F (eo,t) ; F (e k , t)) dt 

i=iv(l-fc) u 

< sup |Cov (F{e ,t);F(e k ,t + u))- Cov (F (e ,t) ;F (e k ,t))\ 

t,ue[o,i],|t-u|<£ 

+- sup \Cov(F(e ,t);F(e k ,t))\ 
n te[o,i] 

which goes to as n tends to infinity under the continuity assumption. The convergence 
of to a 2 follows. 

n 

The end of the proof of Proposition S] is a direct application of Corollary 1 in |llj . 



< 2 V / Q 2 (u) du 



5 Simulations 



The simulations have been realized using Matlab. The minimisation is made with the 
function searchmin by setting to 2000 the options MaxFunEvals and Maxlter, so that the 
method reaches the minimum. 

For all the simulations, the observation time is of 20 s. The trajectory of the observer has 

' equal to 0.25 km/s and makes maneuvers with norm 



a speed with constant norm 
d 2 0(t) 



dt 



of acceleration 



dt 2 



of approximatively 50m/s 2 . The trajectory is mainly composed 

of uniform linear motions and circular uniform motions. The different sequences of the tra- 
jectory of the platform are described in the following table. The null values of acceleration 
correspond to uniform linear motions and the others to uniform circular motion. 



time interval (s) 


0-6 


7-10 


11 - 14 


15 - 20 


norm of acceleration (m/s 2 ) 


50 





-55 






The positive and negative values for norm of acceleration correspond respectively to 
anticlockwise and clockwise circular motion. The transition sequences between circular 
motion and linear motion which are the time intervals [6, 7], [10, 11], and [14, 15] are such 
that the whole trajectory is C°°. 

The assumed parametric model is a uniform linear motion with a speed of 0.27 km/s. 
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The parameter 9 is defined by 



) 



T 



%o yo v x 



V, 



1/ 



where (xo,yo) denotes the initial position and (v x ,v y ) the speed vector. The parametric 
trajectory is then defined by 



The observation noise is a sequence of i.i.d centered Gaussian variables with variance a = 
10~ 3 rad. The platform receives 2000 observations. 

For the first simulation, we consider a sequence (£k)keN of i.i.d Gaussian centered ran- 
dom variables with variance a x x I2 and ax = 10 m. The figure Q] shows the trajectory of 
the platform with a realization of a trajectory of the target and the parametric trajectory 
with parameter 9 n and also the confidence area with level of 95% for the position at final 
time. The figure H] presents the same for the maximum likelihood estimator (MLE) 9 n . 

By using Monte-Carlo methods with 1000 experiments, histograms of the coordinates 
of \fn{Q n — 9*) are presented on figure [2] with the marginal probability densities of the 
asymptotic law J\f(0, 1^(9*)) in dotted line. The empirical cumulative distribution func- 
tions of the coordinates of y/n(9 n — 9*) are presented on figure [3] juxtaposed to the marginal 
cumulative distributions of law Af(0, 1^(9*)). These two figures illustrate the convergence 
in distribution given by Theorem since the sequence (ek)keN is an i.i.d. sequence of 
isotropic random variables. 

The figure [5] present the histograms of the coordinates of ^/n(9 n — 9*) with the marginal 
probability densities of the asymptotic law M(0, I^ 1 (9*)) in dotted line. Empirical cumu- 
lative distribution functions of the coordinates of y/n(9 n — 9*) and marginal cumulative 
distributions of law AA(0, I^ 1 (9*)) are presented on figure [6l These two figures illustrate 
the convergence in distribution given by Theorem 

Confidence intervals for coordinates of 9* with level of 95% are detailed in table [T1 for 9 n 
and in table[3]for 9 ri and are respectively denoted by ICi(# n ) and IC3(6* n ). We also present 
in table conservative confidence intervals denoted by IC2(# n ) built on the result provided 
by Theorem [3] with i? m i n = 6 km. The choice of ax and i? m i n is a prior knowledge on the 
experiment and is made according to the knowledge of the tactical situation of BOT. Note 
that the maj oration obtained in ([7|) shows that the accuracy of the conservative confidence 
intervals is proportional to the ratio ^fe-^-. This result is very interesting in practice since 



it shows that for high values of relative distance between target and observer and small 
values of state noise variance, conservative confidence intervals are of high accuracy. 



involve expectations of functions of the r.v. E\ with law M(0, a\ x I2). All integrals of this 




For these simulations, one needs to calculate I^{9 n )^ 1^,(9*), I{9 n ) and 1(9*) which 
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type has been calculated using quadrature formula with 12 points. Abscissas and weight 
factors are given in pQ. Let us detail the numerical values of I^(9 n ) and a 2 x In(9 n ) for 
one experiment used to build the estimators 9 n and 9 n . These numerical values illustrate 
that the contributions of state noise and observation noise are of the same level. 



/ 



10" 



o 2 x I R (9 n ) 



1(T 



0.0010 
-0.0014 

0.0049 
-0.0094 

0.0015 
-0.0023 
0.0082 
-0.0169 



-0.0014 
0.0024 
-0.0094 
0.0220 



0.0049 
-0.0094 

0.0400 
-0.0950 



V 



-0.0023 
0.0043 

-0.0169 
0.0428 



0.0082 
-0.0169 

0.0728 
-0.1853 



-0.0094 \ 

0.0220 
-0.0950 

0.2709 J 

-0.0169 \ 
0.0428 
-0.1853 
0.5639 



Let us now precise the values of variance matrices. We have 



and 



The true parameter 9* is 





3 


4917 


3 


8949 


0.1560 


-0.1399 




3 


8949 


4 


3496 


0.1752 


-0.1561 







1560 





1752 


0.0074 


-0.0062 


V 


-0 


1399 


-0 


1561 


-0.0062 


0.0056 


/ 


3 


3918 


3 


7884 


0.1526 


-0.1359 




3 


7884 


4 


2362 


0.1715 


-0.1518 







1526 





1715 


0.0072 


-0.0061 


V 


-0 


1359 


-0 


1518 


-0.0061 


0.0055 


9* 




(2.8 


3.8 


0.225 


-0.15) T 





and values of estimators 9 n and 6 n , used to calculate variance matrices, are 

T 



8753 3.8841 0.2284 -0.1530 



2.8067 3.8077 0.2253 -0.1502 



with xo, yo given in km and v x , v y given in km/s and the position at final time is (7.3, 0.8). 
It appears that the maximum likelihood estimator 6 n is a bit more accurate than 9 n . It is 
not surprising since the MLE is designed specifically for the model, and takes into account 
the state noise. Nevertheless, because of the high calculation cost for the MLE, the BLSE 
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is in practice a very useful alternative. 

For the second simulation, we consider the case of a sequence (efc)fceN of i.i.d Gaussian 

and ax = 10 m. It seems that the 



centered random variables with variance a\ x 



6 2 



1 



results given by Theorems [2] and [5] still hold, even though the sequence (efc)fcgN does not 
have an isotropic distribution, see Figures [HI El and \W\ The estimators values are 



2.8383 3.8440 0.2264 -0.1516 
2.7984 3.7999 0.2253 -0.1499 



The values of variance matrices for the two estimators are 



( 15.4505 
17.0122 
0.6174 
\ -0.6253 



17.0122 
18.7661 
0.6863 
-0.6889 



0.6174 
0.6863 
0.0263 
-0.0250 



-0.6253 \ 
-0.6889 
-0.0250 
0.0253 J 



and 



/ 



V 



12.9538 
14.0399 
0.4766 
-0.5214 



14.0399 
15.2720 
0.5262 
-0.5661 



0.4766 
0.5262 
0.0197 
-0.0192 



-0.5214 \ 
-0.5661 
-0.0192 
0.0210 J 

The confidence intervals detailed in table 2] and table show that the maximum likelihood 
estimator 6 n is significantly more accurate than the BLSE. Comparing to the first simulation 
where the difference is not so large, the higher accuracy of 9 n can be understood because of 
the higher level state noise in this simulation. Then, taking into account this state noise for 
estimating the parameter provides a significantly better result. The conservative intervals 
for -R m in = 6 km described in table [5] are quite large compared to those obtained for the 
first simulation. This inaccuracy results directly from the large value of E||ei|| 2 chosen for 
the state noise. 

For the third and last simulation, the sequence (Ek)k&i is an AR(1) series such that 



e k+ i = $e k + 7] k 



where $ = 0.6 and (rjk)k&i is a sequence of i.i.d. random variables with law A/"(0, cr 2 ,) and 
a v = 8m. Thus, the sequence of state noise (ek)keN is a dependent stationary sequence 
such that the mixing coefficient a& tends exponentially fast to zero as k tends to infinity. 
Then, we observe the predicted behavior described by Proposition HI Indeed, by drawing 
the densities and cumulative distribution functions of the centered Gaussian law with the 
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empirical variance, we observe a very good adequacy to the Gaussian behavior, see figures 

nnandna 
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Trajectories - ULM estimation 
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Figure 1: Trajectories with confidence area for BLSE at final position 




Figure 2: Histograms for BLSE with iid 
Gaussian isotropic sequence 



Figure 3: Cumulative distribution func- 
tions for BLSE with iid Gaussian isotropic 
sequence 
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Figure 4: Trajectories with confidence area for MLE at final position 




Figure 5: Histograms for MLE with iid 
Gaussian isotropic sequence 



Figure 6: Cumulative distribution func- 
tions for MLE with iid Gaussian isotropic 
sequence 
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ICi( 


0n,i) 




IC 2 (0 


n,i) 


|ic 2 (MI 


7.3128 


7.5747 


0.2619 


6.0645 


8.8230 


2.7586 


0.8017 


0.8456 


0.0439 


0.5917 


1.0557 


0.4640 


0.2253 


0.2316 


0.0063 


0.1949 


0.2619 


0.0669 


-0.1558 


-0.1503 


0.0055 


-0.1818 


-0.1242 


0.0576 



Table 1: Confidence intervals for BLSE at 
level 95% 

IC3(0 n ,i 



Table 2: Conservative confidence intervals 
for BLSE at level 95% 

ic 3 (MI 



7.1842 7.4430 

0.7815 0.8249 

0.2222 0.2285 

-0.1529 -0.1475 



0.2588 
0.0434 
0.0063 
0.0054 



Table 3: Confidence intervals for MLE at level 95% 




Figure 7: Histograms for BLSE with iid 
Gaussian non-isotropic sequence 



Figure 8: Cumulative distribution func- 
tions for BLSE with iid Gaussian non- 
isotropic sequence 
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Figure 9: Histograms for MLE with iid 
Gaussian non-isotropic sequence 



Figure 10: Cumulative distribution func- 
tions for MLE with iid Gaussian non- 
isotropic sequence 



ICi(0 nj j) 


1 KMMl 


IC2 (#n,i) 


1 ic 2 (Ml 


7.1040 7.6275 


0.5235 


1.5049 13.2266 


11.7218 


0.7698 0.8552 


0.0854 


-0.1740 1.7990 


1.9730 


0.2204 0.2323 


0.0119 


0.0842 0.3686 


0.2844 


-0.1574 -0.1457 


0.0117 


-0.2740 -0.0291 


0.2449 



Table 4: Confidence intervals for BLSE at Table 5: Conservative confidence intervals 

level 95% for BLSE at level 95% 



IC3 


1 ic 3 (MI 


7.0721 7.5366 


0.4645 


0.7643 0.8388 


0.0746 


0.2201 0.2305 


0.0103 


-0.1552 -0.1446 


0.0107 



Table 6: Confidence intervals for MLE at level 95% 




Figure 11: Histograms for AR(1) se- 
quence, Gaussian adequacy- 



Figure 12: Cumulative distribution func- 
tions for AR(1) sequence, Gaussian ade- 
quacy 



